Determination of Maximum Entropy Multivariate Probability Distribution under some Constraints
نویسنده
چکیده
In this paper, the methods of obtaining maximum entropy bivariate distributions under the constraints, that one of the marginal distributions , both of marginals, or the marginals and correlation between variables are prescribed, are extended for multivariate cases. Then, they are illustrated via some numerical examples.
منابع مشابه
Determination of Maximum Bayesian Entropy Probability Distribution
In this paper, we consider the determination methods of maximum entropy multivariate distributions with given prior under the constraints, that the marginal distributions or the marginals and covariance matrix are prescribed. Next, some numerical solutions are considered for the cases of unavailable closed form of solutions. Finally, these methods are illustrated via some numerical examples.
متن کاملDetermination of Maximum Entropy Probability Distribution via Burg’s Measure of Entropy
Abstract In this paper, we consider the methods of obtaining maximum entropy multivariate distributions via Burg’s measure of entropy under the constraints that the marginal distributions or the marginals and covariance matrix are prescribed. Next, a numerical method is considered for the cases of unavailable closed form of solutions. Finally, the method is illustrated via a numerical example.
متن کاملMaximum Entropy method with non-linear moment constraints: challenges
Traditionally, the Method of (Shannon-Kullback’s) Relative Entropy Maximization (REM) is considered with linear moment constraints. In this work, the method is studied under frequency moment constraints which are non-linear in probabilities. The constraints challenge some justifications of REM since a) axiomatic systems are developed for classical linear moment constraints, b) the feasible set ...
متن کاملProbability Density Function Estimation using theMinMax
| The problem of initial probability assignment consistent with the available information about a probabilis-tic system is called a direct problem. Jaynes' maximum en-tropy principle (MaxEnt) provides a method for solving direct problems when the available information is in the form of moment constraints. On the other hand, given a probability distribution, the problem of nding a set of constra...
متن کاملVelocity Distribution in the 90-degree Bend based on the Probability and Entropy Concept
Practical concept of velocity distribution of pressure flow in the bends is interesting and hence, the professional engineering design has been investigated in the current study. This paper shows that velocity distribution in the bends can be analyzed in terms of the probability distributions. The concept of entropy based on the probability is an applied and new approach to achieve velocity pro...
متن کامل